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ABSTRACT 


Introduction: the National Telehealth Program aims at updating and training doctors in 
the Family Health Teams by means of videoconferencing (VCs), with potential impact on 
improving the health care in remote locations and reducing the displacement of patients. 
In addition, it proposes increased primary care interaction with specialized centers. 
Objectives: presentation and evaluation of the use of the videoconferencing system 
allowing for better planning of action in the project. Methods: 916 evaluation (feedback 
questionnaires were analyzed, completed by participants at the end of 84 VCs in Medi- 
cine, between 2009 and 2013. The VCs are a branch of the National Telehealth Project and 
reach 50 municipalities in Minas Gerais under the coordination of the FM-UFMG. They 
are held via web, requiring minimal equipment in diffuser and receiver centers. Results: 
in the study period, an average of 12.64 municipalities and 19.42 speakers were identi- 
fied. Of these, the average number of doctors was 12.97. The quality parameters achieved 
positive assessment (“great” or “good”? in just 62% for the sound, and 84% for the image. 
The theme was considered “interesting” or “very interesting” by 98%. Conclusions: the 
VCs have been strengthened as an alternative to educational institutions. However, the 
participation of speakers and municipalities in this project was less than desired. The 
comparative analysis of VCs from other areas also reveals a reduced adhesion of doctors. 
Among the problems detected, especially regarding the sound quality, the low quality of 
internet connection in the municipalities may have contributed to this result. 


Key words: Videoconferencing; Telemedicine; Continuing Medical Education. 


RESUMO 


Introdução: o Programa Nacional de Telessatide visa à atualização e capacitação dos 
médicos das Equipes de Saúde da Família por meio de videoconferências (VCs), com 
potencial impacto na melhoria da atenção à saúde em locais remotos e redução do 
deslocamento dos pacientes. Ainda, propõe mais interação da atenção primária com 
centros especializados. Objetivos: apresentação e avaliação do emprego desse sistema 
de videoconferências, possibilitando melhor planejamento das ações do projeto. Mé- 
todos: analisados 916 questionários de avaliação/retroalimentação preenchidos pelos 
participantes ao término de 84 VCs de Medicina, no período de 2009 até 2013. As VCs 
são um braço do Projeto Nacional de Telessaúde e alcançam 50 municípios em Minas 
Gerais, sob a coordenação da FM-UFMG. Elas realizam-se via web, exigindo aparelha- 
gem mínima no centro difusor e receptor. Resultados: no período do estudo, obteve-se 
média de 12,64 municípios e 19,42 conferencistas por VC. Destes, a média de médicos 
foi 12,97. Quanto aos parâmetros de qualidade das VC, alcançaram avaliação positiva 
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Cótimo” ou “bom”) o som em apenas 62% delas e a 
qualidade de imagem em 84%. O tema foi considerado 
“interessante” ou “muito interessante” em 98%. Con- 
clusões: as VCs têm se fortalecido como alternativa 
para instituições educacionais. Porém, a participação 
de conferencistas e municípios nesse projeto foi aquém 
da almejada. Análises comparativas com VCs de outras 
áreas revelam, ainda, reduzida adesão dos médicos. 
Entre os problemas detectados, especialmente quanto 
à qualidade do som, a baixa qualidade de internet nos 
municípios pode ter contribuído para esse resultado. 


Palavras-chave: Videoconferencing; Telemedicine; Con- 
tinuing Medical Education. 


INTRODUCTION 


The advent of new technologies and their constant 
incorporation into daily life and economic activities 
impacted notable transformations in society over the 
recent years. The medical practice followed this pro- 
cess and has also gone through considerable changes 
in its various fields. One of the innovations that have 
drawn attention is the application of information and 
communication technology to the medical practice is 
generally titled telemedicine or telehealth.! Norris” de- 
fined? telemedicine as the use of these referred tech- 
nologies to transfer information related to clinical, 
educational, and administrative services. 

The applications of telemedicine are several, 
including tele-education with courses conducted 
via the web for medical updating; teleconsulting 
in which it is possible to obtain a second medical 
opinion remotely; telemonitoring when the patient 
is monitored by a doctor in a different location; and 
teleconferencing through which it is possible to hold 
meetings between remote sites for the discussion of 
various subjects related to Medicine.? 

Review studies! have attested advantages linked 
to telemedicine such as reduced need to transport 
patients to specialized centers, data transmission at 
high speed and quality, and reduced time between 
diagnosis and guidance for conduct in various dis- 
eases through teleconsultations. In addition, it allows 
professional updating through distance learning, im- 
proving health care in places of difficult access, and 
interaction between specialized centers with the re- 
cording and storing of exchanged information. It al- 
lows medical updating and potentially cost reduction 
impact in the assistance. 

In Brazil, due to its extensive territory and inef- 
ficient distribution of resources, telemedicine could 


be of great assistance to facilitate access to available 
protocols, distance education, collaborative research 
between educational centers, second opinion consul- 
tations, and improved assistance to the population, 
especially in remote or deficient areas where access 
to medical services is precarious. The lag between 
time of diagnosis and treatment decreases, which in- 
creases the efficiency of medical services, justifying 
the investment in technology! 

Possible disadvantages are the high cost of the 
equipment required for its implementation, the need 
for specialized technicians for the installation and 
maintenance of equipment and dependence on the 
quality of internet connection where telemedicine 
tools will be implemented.º 

The National Telehealth Program is a governmen- 
tal action developed in conjunction with several Bra- 
zilian universities. It proposes the use of these tools 
available for telemedicine to better empower family 
health teams and raise the quality of basic care pro- 
vided by the Unified Health System. Still, it aims to 
encourage primary care interaction with specialized 
centers from universities. 

The Medical School at the Federal University of 
Minas Gerais is one of the core sites in the project 
since the beginning of 2008 providing assistance and 
educational support through teleconsultations (on- 
line and offline) and videoconferences for 50 munici- 
palities in the State. The focus of this study is the use 
web conferencing aiming to upgrade and train family 
health teams (ESF) on various medical topics, in all 
cities covered by the project. 

Therefore, doctors and teachers are invited; ex- 
perts in their area of operation, to minister videocon- 
ferences on subjects previously selected by doctors in 
the family health teams. 

The International Telecommunication Union de- 
finesº videoconferencing as an audiovisual interac- 
tive chat service that provides a bi-directional and 
real-time exchange of audio and video signals among 
user groups in two or more locations. 

In other words, it is an audio-visual communica- 
tion system between geographically distant sites that 
is gaining space in the medical practice in the context 
of telemedicine. It is useful in the implementation of 
consulting for second opinions, remote professional 
training, non-face-to-face meetings, and participation 
in health activities!. This remote professional train- 
ing, or more specifically continuing medical educa- 
tion, is the most widespread use of teleconferencing.” 
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Due to the rapid evolution of medical knowledge, 
studying and continuous updating are indispensable 
for all medical professionals. Continuing medical 
education represents a growing need to improve the 
quality of health care and is a central element in the 
organization of health systems.* 

In several areas of medical education, non-tradi- 
tional teaching strategies, such as teleconferences, 
proved to be at least as effective as traditional strat- 
egies.” They should, however, be seen as a comple- 
ment and not substitute strategy. 


OBJECTIVES 


The present study aims to evaluate the use of vid- 
eo conferencing by the National Telehealth Project 
between 2009 and 2013 tracing the encountered re- 
sults and difficulties. Permission is granted to a reflec- 
tion about the initiative coordinated by the Center for 
Telehealth (NUTEL) of the Health Technology Center 
of the Medical School at UFMG. 


MATERIALS AND METHODS 


The Center for Telehealth at UFMG holds videocon- 
ferences with professionals in the areas of Dentistry 
and Nursing. In the present study, only the telemedi- 
cine videoconferences coordinated by Dr. Gustavo 
Cancela e Penna, an endocrinologist and employee at 
UFMG and NUTEL member, will be addressed. 

Between 2009 and 2013, a total of 84 medical vid- 
eoconferences occurred. They happened every two 
weeks, on Thursdays afternoon. They were accom- 
panied by the video conference coordinator from 
NUTEL and a technical manager responsible for the 
initialization, fixing potential problems that occur 
during transmission, and VC recording. 

The equipment used by participants in the target 
municipalities are multimedia sound, webcam, and 
a conventional desktop computer. These inputs were 
provided by the National Telehealth Project and im- 
plemented by the NUTEL technical team, which aids 
in the assembly and training for the use of telemedi- 
cine tools offered by UFMG. 

Conversely, the municipalities must encourage 
the participation of doctors from the basic attention 
and support and provide an internet bandwidth with 
a suggested minimum speed of 128 Kbps and unre- 
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stricted access to the web. The doctors then connect 
by means of a browser to the address http://www .te- 
lessaude.ufmg.br, where the link to access the Adobe 
Connect? Server is available, which hosts the meet- 
ing. No additional settings are required in the equip- 
ment such as adding codecs or installation of soft- 
ware; it presents only one technical requirement that 
is the use of a browser with the Flash Playerº plugin, 
already native in the vast majority of them. 

VC speakers use a room dedicated to the project 
in the FM-UFMG and connect via the web as well as 
users. To send audio, video, and speaker presenta- 
tion, Adobe Connect” takes care of receiving and dis- 
tributing the data to other participants, automatically 
managing technical aspects of connectivity such as 
video submission rate (standard as 30 FPS), audio 
distribution via VolP, resolution, compression rate, 
frames per second, and codec. 

The technical aspects used for the implementa- 
tion of Adobe Connect Serverº followed parameters 
suggested by the manufacturer: Microsoft Windows 
Server? 2008 operating system and physical server 
Intel Xeonº dual-core 3 GHz; these were physically in- 
stalled in a Data Processing Center at the FM — UFMG 
also at the expense of National Project. 

À semi-annual selection of topics to be present 
ed is performed for the video conferencing planning 
considering prevalence of diseases in the basic at- 
tention, demand of professionals in each region, 
and emergency public health issues such as out- 
breaks and epidemics. This selection occurred in 
one VC when doctors from health teams voted and 
defined themes. 

From the selection of themes, a schedule with 
date and time for video conferences, guest speaker, 
and title are set. Some actions were reinforced and 
recalled during the sessions event to intensify the 
participation of health professionals: sending posters 
with the half-yearly schedules to the Municipal Secre- 
tary of Health, notifications via e-mail, phone calls, or 
messages by cell phones; charge on stimulation roles 
towards the project on responsible individuals for pri- 
mary health care in the municipalities. 

The videoconference lectures last for 30 minutes 
and are taught by specialists in their area of work who 
are invited by the project coordination. At the end of 
this time, participants can ask questions to the speak- 
er via chat available in the same virtual environment. 
The questions are read and discussed allowing other 
participants to follow. 
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With the purpose of feedbacking the project, par- 
ticipants are asked to answer an online survey at the 
end of VCs. The survey asks questions about the per- 
ception of audio and video quality, interest in the is- 
sue, areas of expertise of professionals who attended 
the lecture, and the number of participants per mu- 
nicipality because it there is usually to more than one 
professional attending the VCs in the same access site. 

A total of 916 evaluation questionnaires/feedback 
were obtained throughout this study. These data were 
archived in Excel spreadsheets and analyzed. The re- 
sults of these questionnaires are presented in the fol- 
lowing graphs. 


RESULTS 


Based on the analysis of916 VC questionnaires, some 
data enable the assessment of the coverage achieved by 
the project. Considering the quota of 50 municipalities 
included in this core of the National Telehealth Project, 
the average of 12.64 municipalities per session repre- 
sents the percentage of 25.28% attendance. 

The number of professional participants averaged 
in 19.42 professionals per session. The training of these 
participants was distributed as 12.97 doctors repre- 
senting 66.78% of the quota. Thus, the participation of 
several other non-doctor health professionals in the 
videoconferences, during the study period and in the 
covered cities, was represented by nurses, nursing as- 
sistants, dentists, and community workers. The massive 
participation of nurses stood out among these. 

However, a progressive decline in the number of 
VC participants between 2010 and 2013 was observed, 
with maintenance in the doctors' average and reduced 
participation by other professionals. The relationship 
between professional participants in total and the total 
number of doctors is shown in the graph in Figure 1. 

The technical aspects evaluated by participants 
were the perception of sound and image quality. The 
questionnaire assessed this perception of quality 
with the following options: great, good, regular, bad, 
and terrible. Positive assessment (“great” or “good”) 
was achieved for sound in only 62% (569), and im- 
age quality for 84% (769). The t-test reveals p < 0.05 
for these variables, and may, therefore, indicate that 
there was a significant difference between the per- 
ception of the quality of sound and image. The fol- 
lowing graphs show the percentage values obtained 
for each concept in the evaluations of sound (Figure 


2) and image (Figure 3) during the studied period. 
There were no major variations in the distribution of 
concepts in the five years of study. 
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Figure 1 - Relationship between total number of pro- 


fessionals in general and number of participating 
doctors in the period from 2009 to 2013. 
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Figure 2 - Evaluation of sound quality in videocon- 
ferences showing the percentage obtained in each 
concept in the years from 2009 to 2013. 


The evaluation of personal interest in the topics 
addressed in VCs, in turn, relied on the response op- 
tions in the questionnaire: very interesting, interest- 
ing, of little interest, and not interesting. The theme 


Rev Med Minas Gerais 2015;25(1):104-110 


107 


Evaluation of the use of videoconferencing for distance training of doctors in the family health teams within the national... 


108 


was considered “interesting” (372) or “very interest- 
ing” (528) in 98% of 916 questionnaires. Similarly, 
there are no major variations in the concept obtained 
over the years of study. 
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Figure 3 - Evaluation of image quality in videoconfe- 
rences showing the percentage obtained in each con- 
cept in the years from 2009 to 2013. 
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Figure 4- Evaluation of the interest in the topic addres- 
sed in the conferences showing the percentage obtai- 
ned in each concept in the years from 2009 to 2013. 
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DISCUSSION AND CONCLUSIONS — 


The drop in hardware and telecommunications 
costs, beside software development in the area, opens 
a space for new solutions adapted to the “bottlenecks” 
of health services. The use of technology brings ex- 
pectation and curiosity in using new ways to acquire 
knowledge.º Thus, video conferencing has been 
strengthened with a viable alternative to educational 
institutions offering distance education in Brazil! a 
country with an extensive territory and uneven distribu- 
tion of basic attention to health. The experiences of dis- 
tance learning through video conferencing have shown 
positive results in relation to the connected parts. 

Australian studies!? demonstrated the efficiency 
and effectiveness of learning using videoconferencing, 
reported as being appropriate or even an equivalent 
alternative, in some cases, to the classroom arrange- 
ment. A potential expansion of educational coverage 
with the use of this technology was also noticed be- 
cause it increases the possibility of reaching doctors 
without access to the traditional forms. One the restric- 
tions for travel time and costs of accommodation are 
eliminated teleconferences provide! remote continu- 
ing medical education opportunities that are similar to 
those provided to doctors in large cities. 

All these data justify the investments of the Na- 
tional Telehealth Project and our expectation with the 
implementation of its core coordinated by UFMG in 
Minas Gerais. The results already presented, frustrate, 
in part, that initial enthusiasm. It was observed that the 
number of participating cities was still low in relation 
to the total number of cities covered by the project. 

The comparative analysis with data, not yet pub- 
lished by the authors, between the participation of 
professionals in videoconferences of telemedicine, 
telenursing, and teledentistry that have the same ef- 
fective mechanisms indicates that the participation in 
telemedicine is inferior to the others, which suggests re- 
duced adherence to this activity on the part of doctors. 

It is also interesting to note the substantial partici- 
pation (33%) of other non-doctor health professionals 
in telemedicine VCs, with the majority being nurses. 
Further studies are needed to understand this phenom- 
enon; however, some considerations can be drawn. 

The existence of family health teams, at the time, 
without participating doctors; significant lack of in- 
terest from doctors compared to other profession- 
als; hours of work that traditionally load the medical 
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class and, in counterpoint, VCs occur during business 
hours on Thursdays; lack of management incentive to 
participate in the project. These are all elements to be 
considered on the results obtained in this study. 

Thus, it is essential to develop a more effective sys- 
tem of dissemination and effectiveness for this video- 
conferencing project to have doctors in each city using 
the opportunity and feeling interested in participatins. 
This is called sensitization. According to Melo and Sil- 
va (2006), the inclusion of municipal managers in this 
awareness is also essential for the viability of services 
to be offered, as well as for the process of increasing 
the participation of professionals who will use the re- 
sources. This joint responsibility by those in charge for 
primary health care in the municipalities is already an 
adopted strategy, however, more efficient mechanisms 
to propose and charge a policy that encourages and al- 
lows doctors to participate in VCs in the UBS are need- 
ed. As a comparison, the strand of teleconsultations of 
the National Telehealth Project, also conducted by FM- 
UFMG, includes financial incentives and penalties for 
the participation of municipalities. 

Regarding the quality of VCs, the questionnaires 
showed deviation in the parameters of image and 
sound. That is, the perception of the quality of the 
picture was positive while that of sound was negative. 

The audio and video quality is critical! to the suc- 
cess of participation at a distance to allow partici- 
pants to feel truly as part of the meeting. In videocon- 
ferences, small video “hiccups” (pixelation, freezing, 
etc.) are for the most part tolerated by users while 
audio “hiccups” affect them more intensely. 

Technical analysis” of similar experiences in tele- 
medicine VCs demonstrated that participants could ob- 
serve an echo effect on audio or “ghost images” in the 
case of sudden movements if the bandwidth of the in- 
ternet is not enough on either side. The result would be 
a distracting interference to the learning environment. 

Consistent problems in the quality of video have 
not been reported, however, problems of low audio 
quality on some of our videoconferences was found 
by the technical staff and it was detected as second- 
ary to the network “bottleneck”, i.e. resulting from the 
low quality of connectivity due to internet services 
available in municipalities. As already reported, to of- 
fer internet access with a minimum required speed 
(128 Kbps) is the responsibility of the participating 
municipalities, however, the possible unavailability of 
appropriate servers in inner cities, band sharing with 
other activities, and absence of monitoring mecha- 


nisms by the project are elements that may have con- 
tributed to this result. 

These initial problems may have reduced the ex- 
pected return of VCs and discouraged the participa- 
tion of some teams. As a measure to overcome this 
obstacle, Nutel of UFMG is also investing the improve- 
ment of training for computer professionals in the mu- 
nicipalities involved as a way to detect and minimize 
transmission problems, mainly in relation to sound. 
The effort and investment in improving the sound 
quality of videoconferences will be reverted, certain- 
ly, to the satisfaction of participants. 

Still in the field of actions, the organization, and 
ongoing implementation of a virtual library in which 
all videoconferences held within the National Tele- 
health Project are stored constitute a major break- 
through. This demands formal authorization by lec- 
turers and availability of servers, both conditions 
have been already overcome. This library will allow 
the provision of a representative collection of lessons 
available to other municipalities in the State of Minas 
Gerais, which are also in need of this training, and 
enable access to continuing medical education to 
physicians who, for some reason, cannot participate 
in videoconferences in real time. The development 
of an infrastructure to support virtual learning goes 
through the implementation of these virtual libraries.” 

A study on the conditions for the success of 
telehealth strategies such as this project indicated 
that there is a need also to take into consideration 
the needs of doctors and their expectations, making 
them active in decision-making. The largely positive 
evaluation of the VCs themes reflects a choosing pro- 
cess centered on participants. Therefore, it is still nec- 
essary to adapt the project to facilitate its suitability to 
the routine of doctors and clinical practices motivat- 
ing and sensitizing the participation of these profes- 
sionals with a solid disseminating strategy. 

Finally, the benefits of telemedicine are only vis- 
ible after a period of time while its implementation 
and development require immediate investments. As 
for the benefits that are less “tangible” such as im- 
provement in the clinical practice through continuing 
medical education in our project, the difficulties are 
even greater. This implies the difficulty and needs to 
strengthen the adoption of these strategies with pub- 
lic health managers. Hence, finding more effective 
mechanisms to obtain this necessary involvement for 
the success of video conferences of the National Tele- 
health Project is needed. 
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